Interaction method, interaction apparatus, and user equipment

ABSTRACT

Embodiments of the present application disclose an interaction method, an interaction apparatus, and user equipment. The method comprises: determining shape related information of a deformable interaction surface, where the deformable interaction surface is at least used to perform information input, and the shape related information corresponds to a first shape of the deformable interaction surface after a folding deformation; determining multiple effective interaction areas on the deformable interaction surface at least according to the shape related information, where the multiple effective interaction areas meet the following conditions: in nonadjacent positions on the deformable interaction surface, and adjacent in a spatial position in the first shape; and using the multiple effective interaction areas as one interaction area at least according to a first relative position of the multiple effective interaction areas in the spatial position in the first shape to provide an information input interface to at least one interaction object. The technical solutions in the embodiments of the present application can bring new experience to a user according to a deformation property of a deformable device.

CROSS REFERENCE TO RELATED APPLICATION

The present application is based on and claims the benefit of priorityto Chinese Application No. 201610081056.3, filed on Feb. 4, 2016, theentire contents of which are incorporated herein by reference.

TECHNICAL FIELD

The present application relates to the field of interactiontechnologies, and in particular, to an interaction method, aninteraction apparatus, and user equipment.

BACKGROUND

With the development of technologies, deformable devices such asflexible devices become increasingly popular. Deformable devices havechangeable shapes, and therefore bring users a lot of new userexperience. For example, demands of users for wearable devices to meetdifferent body curves, demands for devices to have increased sizes forusing and decreased sizes for carrying, and the like are met moreeasily. When deformable interaction devices are used to performinteraction, different experience is also brought to users.

SUMMARY

A possible objective of embodiments of the present application is toprovide an interaction solution based on a deformable interactionsurface.

According to a first aspect, a possible implementation solution of thepresent application provides an interaction method, comprising:

determining shape related information of a deformable interactionsurface, where the deformable interaction surface is at least used toperform information input, and the shape related information correspondsto a first shape of the deformable interaction surface after a foldingdeformation;

determining multiple effective interaction areas on the deformableinteraction surface at least according to the shape related information,where the multiple effective interaction areas meet the followingconditions: in nonadjacent positions on the deformable interactionsurface, and adjacent in a spatial position in the first shape; and

using the multiple effective interaction areas as one interaction areaat least according to a first relative position of the multipleeffective interaction areas in the spatial position in the first shapeto provide an information input interface to at least one interactionobject.

According to a second aspect, a possible implementation solution of thepresent application provides an interaction apparatus, comprising:

an information determining module, configured to determine shape relatedinformation of a deformable interaction surface, where the deformableinteraction surface is at least used to perform information input, andthe shape related information corresponds to a first shape of thedeformable interaction surface after a folding deformation;

an area determining module, configured to determine multiple effectiveinteraction areas on the deformable interaction surface at leastaccording to the shape related information, where the multiple effectiveinteraction areas meet the following conditions: in nonadjacentpositions on the deformable interaction surface, and adjacent in aspatial position in the first shape; and

an information input interface providing module, configured to use themultiple effective interaction areas as one interaction area at leastaccording to a first relative position of the multiple effectiveinteraction areas in the spatial position in the first shape to providean information input interface to at least one interaction object.

According to a third aspect, a possible implementation solution of thepresent application provides user equipment, where the user equipmentcomprises:

a memory, configured to store a program; and

a processor, configured to execute the program stored in the memory, theprogram causes the processor to execute the following operations:

determining shape related information of a deformable interactionsurface, where the deformable interaction surface is at least used toperform information input, and the shape related information correspondsto a first shape of the deformable interaction surface after a foldingdeformation;

determining multiple effective interaction areas on the deformableinteraction surface at least according to the shape related information,where the multiple effective interaction areas meet the followingconditions: in nonadjacent positions on the deformable interactionsurface, and adjacent in a spatial position in the first shape; and

using the multiple effective interaction areas as one interaction areaat least according to a first relative position of the multipleeffective interaction areas in the spatial position in the first shapeto provide an information input interface to at least one interactionobject.

In at least one implementation solution of the embodiments of thepresent application, after a deformation of a deformable interactionsurface occurs, multiple effective interaction areas adjacent in aspatial position are recombined to form a new interaction area used toprovide an information input interface to an interaction object, therebybringing new experience to a user by using a deformation property of adeformable device.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flowchart of an interaction method according to anembodiment of the present application;

FIG. 2a to FIG. 2e are schematic diagrams of an application scenario ofan interaction method according to an embodiment of the presentapplication;

FIG. 3a and FIG. 3b are schematic diagrams of two shapes of a deformableinteraction surface being folded in an interaction method according toan embodiment of the present application;

FIG. 4 is a schematic structural block diagram of an interactionapparatus according to an embodiment of the present application;

FIG. 5a to FIG. 5e are schematic structural block diagrams of fiveinteraction apparatuses according to an embodiment of the presentapplication;

FIG. 6a to FIG. 6b are schematic diagrams of an application scenarioaccording to an embodiment of the present application;

FIG. 7a to FIG. 7c are schematic diagrams of an application scenarioaccording to an embodiment of the present application;

FIG. 8a to FIG. 8b are schematic diagrams of an application scenarioaccording to an embodiment of the present application;

FIG. 9a to FIG. 9c are schematic diagrams of an application scenarioaccording to an embodiment of the present application; and

FIG. 10 is a schematic structural block diagram of user equipmentaccording to an embodiment of the present application.

DETAILED DESCRIPTION

The specific implementing manners of the present application are furtherdescribed below in detail with reference to the accompanying drawings (asame reference numeral in several drawings represents a same element)and embodiments. The embodiments below are used for describing thepresent application rather than to limit the scope of the presentapplication.

A person skilled in the art may understand that, terms such as “first”and “second” in the present application are only used to distinguishdifferent steps, devices or modules and the like, but do not representany specific technical meanings, and do not denote a necessary logicorder among the steps, devices or modules and the like.

The inventor of the present application finds that, because a deformableinteraction surface has a changeable shape, after a deformation occurs,for some effective interaction areas before the deformation, forexample, areas that are covered or blocked after the deformation occurs,effective interaction may no longer be able to be performed after thedeformation occurs. Meanwhile, some multiple interaction areas that areoriginally scattered may become multiple effective interaction areasadjacent in a spatial position after the deformation occurs, andeffective use of the multiple effective interaction areas may cause adeformable device to bring more desirable user experience to a user.

In the following description of the present application:

An interaction object of the deformable interaction surface may be auser, or may be an electronic device and the like.

An effective interaction area is an area where effective interaction maybe performed with an interaction object. In a possible implementingmanner, the effective interaction area may be an area with which aninteraction object may perform interaction. For example, when thedeformable interaction surface is a touch input surface, the effectiveinteraction area is an area that may be conveniently touched by theinteraction object. In some possible implementing manners, for example,it may be set that there is no obstacle within a set distance range on aside faced by the effective interaction area; and/or it is set that theeffective interaction area faces a side where the interaction object islocated; and so on. Alternatively, further, in another possibleimplementing manner, in addition to that an interaction object mayperform interaction, it is further required that the interaction meets aset interaction condition, to cause interaction between the effectiveinteraction area and the interaction object to achieve an expectedinteraction effect. For example, the interaction condition may comprisethat: interaction information acquired by using the effectiveinteraction area is consistent with interaction information that isintended to be input by using an interaction object.

A position of an area on the deformable interaction surface is: aposition of a coordinate area corresponding to the area on a coordinatesurface, where the deformable interaction surface is used as thecoordinate surface. Regardless of how a shape of the deformableinteraction surface is bent or folded, a coordinate area correspondingto an area does not change.

A spatial position of an area is a position of the area in a spatialcoordinate system.

As shown in FIG. 1, an embodiment of the present application provides aninteraction method, comprising:

S110: Determine shape related information of a deformable interactionsurface, where the deformable interaction surface is at least used toperform information input, and the shape related information correspondsto a first shape of the deformable interaction surface after a foldingdeformation.

S120: Determine multiple effective interaction areas on the deformableinteraction surface at least according to the shape related information,where the multiple effective interaction areas meet the followingconditions: in nonadjacent positions on the deformable interactionsurface, and adjacent in a spatial position in the first shape.

S130: Use the multiple effective interaction areas as one interactionarea at least according to a first relative position of the multipleeffective interaction areas in the spatial position in the first shapeto provide an information input interface to at least one interactionobject.

In a possible implementing manner, the deformable interaction surface,for example, may comprise at least one of the following:

a light information input surface, a sound information input surface, atouch sensing surface, and the like.

For example, the interaction apparatus provided in the presentapplication is used as an execution subject in this embodiment toexecute S110 to S130. Specifically, the interaction apparatus may bedisposed in user equipment in a manner of software, hardware or acombination of software and hardware, or, the interaction apparatus maybe the user equipment. The user equipment comprises but not limited to amobile phone, a computer, a television, a wearable device or the likethat has a deformable interaction surface that allows a foldingdeformation.

In an implementing manner in this embodiment of the present application,after a deformation of a deformable interaction surface occurs, multipleeffective interaction areas adjacent in a spatial position arerecombined to obtain one new interaction area used to provide aninformation input interface to an interaction object, thereby bringingnew experience to a user by using a deformation property of a deformabledevice.

The method in this embodiment of the present application is furtherdescribed by using the following implementing manners.

In a possible implementing manner, a shape of a deformable interactionsurface 200 being unfolded is a rectangle shown in FIG. 2a . During afolding deformation, the rectangle shown in FIG. 2a turns into a wavystate shown in FIG. 2b and eventually becomes a folded state shown inFIG. 2c . FIG. 2d is a right diagram of FIG. 2 c.

As can be seen from FIG. 2a to FIG. 2d , after a folding deformation ofa deformable interaction surface 200 occurs, a part of the interactionarea (for example, wing-surface areas 212 to 215) is folded and blockedand is no longer an effective interaction area. In some possibleimplementing manners, another part of interaction area (for example,wing-surface areas 211 and 216) may also be no longer an effectiveinteraction area because of a facing-direction problem (for example, aninteraction direction D of an interaction object to the deformableinteraction surface 200 is a direction right opposite the deformableinteraction surface 200 shown in FIG. 2a to FIG. 2c ).

In the implementing manner shown in FIG. 2a to FIG. 2d , only severalremaining folding areas 221 to 225 where several outwardly-bending endsurfaces are located are effective interaction areas that still can beused to perform effective interaction with an interaction object.

In this embodiment of the present application, a folding area is an areacorresponding to a bending end that connects two opposite wing surfacesin a creased structure. For example, a folding area 221 is an areacorresponding to a bending end that connects two opposite wing surfaceareas 211 and 212 after folding.

Conventionally, after the foregoing folding deformation is performed onthe deformable interaction surface 200, for remaining effectiveinteraction areas, a possible manner is: an interaction function of theentire deformable interaction surface 200 is turned off, and interactionis no longer performed with the interaction object. Another possiblemanner is: The remaining effective interaction areas are still used as apart of the information input interface before the deformation toperform incomplete interaction with the interaction object.

The inventor of the present application finds that, in some scenarios,after the folding deformation of the deformable interaction surfaceoccurs, multiple effective interaction areas adjacent in a spatialposition may be formed. Although an area of one effective interactionarea may be relatively small and can hardly be used as a separateinformation input interface to perform interaction with an interactionobject, the multiple effective interaction areas may be recombined intoone relatively large interaction area and may be reused.

In this embodiment of the present application, shape related informationcorresponding to the first shape of the deformable interaction surfaceafter a folding deformation is determined, and the multiple effectiveinteraction areas are then determined according to the shape relatedinformation.

In a possible implementing manner, optionally, the shape relatedinformation may comprise:

the first shape information of the first shape.

For example, in the implementing manner shown in FIG. 2a to FIG. 2d ,shape information of the deformable interaction surface after thefolding shown in FIG. 2c and FIG. 2d may be acquired as the shaperelated information.

In another possible implementing manner, optionally, the shape relatedinformation may also be not the first shape information, and instead mayindirectly obtain other information of the first shape information. Forexample, the shape related information comprises:

second shape information of a second shape of the deformable interactionsurface before the folding deformation, and deformation informationcorresponding to the folding deformation.

Here, the deformation information may be a shape change parameter, ormay be another parameter related to a deformation. For example, when thedeformable interaction surface is a thermally-induced deformationmaterial, the deformation information may comprise temperature changeinformation and the like of areas. Alternatively, for example, thedeformation information may further be displacement information, ofareas on the deformable interaction surface, acquired by using anacceleration sensing array, a gyroscope array, and the likecorresponding to the deformable interaction surface.

A person skilled in the art may know that the first shape may also bedetermined according to the second shape information and the deformationinformation.

In a possible implementing manner, the deformable interaction surface isan interaction surface whose deformation is controllable, and isconfigured to perform different deformations according to differentdeformation control instructions. The deformation control instructionmay be generated in response to an interaction object interactionoperation. In a possible implementing manner, according to a beforehandsetting, each deformation control instruction may correspond to shapeinformation after a deformation; or may correspond to a piece ofdeformation information. Therefore, in S110, the shape relatedinformation may be determined at least according to a deformationcontrol instruction, where the deformation control instruction is usedto control the folding deformation of the deformable interactionsurface.

For example, in the implementing manner as shown in FIG. 2a to FIG. 2d ,a first deformation control instruction may be obtained in response toan operation that a user clicks a “Fold” button. The first deformationcontrol instruction corresponds to the shape shown in FIG. 2c . In thiscase, regardless of a shape of the deformable interaction surface beforea folding deformation, once the first deformation control instruction isacquired, the deformable interaction surface is automatically controlledto deform into the shape shown in FIG. 2 c.

In other possible implementing manners, for example, when thedeformation control instruction corresponds to deformation information,in S110, the second shape information further requires to be acquired toobtain the shape related information.

In addition to the foregoing the deformation control instruction, adeformation sensor configured to acquire corresponding deformationsensing information according to a deformation of the deformableinteraction surface may be further used to obtain the deformationrelated information. The deformation sensor, for example, may generate acorresponding voltage or current parameter value according to adeformation of the deformable interaction surface, where the deformationsensing information is the voltage or current parameter value.

In a possible implementing manner, after the folding deformation of thedeformable interaction surface occurs, the shape related information maybe determined at least according to the deformation sensing information.

In the method in this embodiment of the present application, after theshape related information is acquired, the multiple effectiveinteraction areas may be determined at least according to the shaperelated information.

In this embodiment of the present application, the multiple effectiveinteraction areas meet the following conditions: in nonadjacentpositions on the deformable interaction surface, and adjacent in aspatial position in the first shape.

Here, the multiple effective interaction areas are adjacent in a spatialposition in the first shape, and therefore can be recombined into oneinteraction area.

In this embodiment of the present application, if two effectiveinteraction areas are in adjacent positions on the deformableinteraction surface and are adjacent in the spatial position in thefirst shape, the two effective interaction areas may be seen as oneeffective interaction area.

In a possible implementing manner, that the multiple effectiveinteraction areas are adjacent in the spatial position comprises:

for a first effective interaction area of the multiple effectiveinteraction areas, at least another effective interaction area that isadjacent in the spatial position to the first effective interaction areaexists,

where the first effective interaction area is any effective interactionarea of the multiple effective interaction areas.

In a possible implementing manner, that two effective interaction areasare adjacent in a spatial position may be that a distance between nearbyedges of the two effective interaction areas is approximately 0. Forexample, in the implementing manner shown in FIG. 2c and FIG. 2d , twoadjacent effective interaction areas adjoin.

Alternatively, in another possible implementing manner, that twoeffective interaction areas are adjacent in a spatial position may bethat a distance between nearby edges of the two interaction areas isless than a set value. For example, the deformable interaction surfaceshown in FIG. 2a may also be folded and deformed into the shape shown inFIG. 2e . A gap area 231 further exists between the two adjacenteffective interaction areas 226, 227. In this implementing manner, whena width (a width in a vertical direction in FIG. 2e ) of the gap area231 is less than set value, it may be considered that the two effectiveinteraction areas 226, 227 are adjacent.

In some possible implementing manners, the set value may be determinedaccording to influence of the distance on interaction of the interactionobject. By using an example in which the deformable interaction surfaceis a touch input surface, if the distance between two adjacent effectiveinteraction areas is too large for a user to perform touch input betweenthe two effective interaction areas (for example, a slide gesture cannotsuccessfully traverse two effective interaction areas), the distancebetween the two effective interaction areas is greater than the setvalue.

In a possible implementing manner, in addition to the shape relatedinformation, other information may further need to be combined to obtainthe multiple effective interaction areas.

For example, in a possible implementing manner, interaction between thedeformable interaction surface and the interaction object isdirectional. In this case, the multiple effective interaction areas mayneed to be determined according to the shape related information and asecond relative position of the interaction object relative to thedeformable interaction surface in the first shape.

In a possible implementing manner, S120 may comprise:

determining, according to the shape related information, multiplefolding areas where multiple outwardly-bending end surfaces are located,where the multiple outwardly-bending end surfaces are adjacent in thespatial position on the deformable interaction surface in the firstshape; and

determining the multiple effective interaction areas at least accordingto the multiple folding areas.

In a possible implementing manner, the multiple effective interactionareas are the multiple folding areas.

As shown in FIG. 2a and FIG. 2c , positions of each two of the multiplefolding areas 221 to 225 on the deformable interaction surface areseparated by at least another interaction area and are not adjacent toeach other. In a deformed spatial position, the multiple folding areas221 to 225 are adjacent. Therefore, in the implementing manner shown inFIG. 2a to FIG. 2d , it may be determined that the multiple foldingareas 221 to 225 are the multiple effective interaction areas.

In some possible implementing manners, in addition to the foregoing themultiple folding areas, the multiple effective interaction areas mayfurther comprise another area that is adjacent to or is connected to themultiple folding areas in the spatial position after the foldingdeformation occurs.

For example, in a possible implementing manner, as shown in FIG. 2a toFIG. 2d , the folding area 221 and the wing-surface area 211 that areconnected may be used as one effective interaction area; and the foldingarea 224 and the wing-surface area 216 that are connected may be used asone effective interaction area.

Further, for example, in the implementing manner shown in FIG. 3a , in acase in which an interaction direction is considered, in addition tofour folding areas 311 to 314, an unfolded area 321 (an area where awing surface is located in a creased structure) is also an effectiveinteraction area facing the interaction object, and is adjacent to thefour folding areas 311 to 314 in the spatial position. Therefore, themultiple effective interaction areas further comprise the unfolded area321.

Therefore, the determining the multiple effective interaction areas atleast according to the multiple folding areas comprises:

determining the multiple effective interaction areas at least accordingto the multiple folding areas and the first shape.

In some possible implementing manners, the determining the multipleeffective interaction areas at least according to the multiple foldingareas may comprise:

determining the multiple effective interaction areas at least accordingto the multiple folding areas, the first shape, and a second relativeposition of an interaction object relative to the deformable interactionsurface after the folding deformation.

In some possible implementing manners, the second relative position maybe real position information acquired in real time. For example, thesecond relative position may be determined by using an interactionobject position sensor on a side of the deformable interaction surfaceor by means of communication with another device on a side of theinteraction object. In other possible implementing manners, the secondrelative position may be set by default, for example, is a common secondrelative position obtained according to use habits of multiple users, oris a second relative position obtained according to a setting by a user.

Certainly, in addition to the foregoing several factors that need to beconsidered, in some other possible implementing manners, during thedetermining the multiple effective interaction areas at least accordingto the multiple folding areas, another factor may further need to beconsidered.

For example, in a possible implementing manner, a characteristic ofinteraction further needs to be considered to determine whether themultiple folding areas are all effective interaction areas. For example,in a possible implementing manner, a first shape of the deformableinteraction surface 200 shown in FIG. 2a after a folding deformation mayalso be shown in FIG. 3b , and four folding areas 315 to 318 may bedetermined according to the first shape. However, in a process ofinteraction with an interaction object, the four folding areas 315 to318 are not necessarily all effective interaction areas. For example,when the deformable interaction surface is a touch input surface, partsclose to each other of two adjacent folding areas may be beyond thereach of an interaction object, and therefore, only a part of eachfolding area is an effective interaction area. For example, as shown inFIG. 3b , according to the four folding areas 315 to 318 and acharacteristic (for example, usually a characteristic such as a shape ofa finger of a user) of an interaction object, four effective interactionareas 315 a to 318 a may be determined.

In this embodiment of the present application, after the multipleeffective interaction areas are determined, the multiple effectiveinteraction areas may be used as one new interaction area to provide aninformation input interface to an interaction object.

In a possible implementing manner, the using the multiple effectiveinteraction areas as one interaction area at least according to a firstrelative position may be: splicing the multiple effective interactionareas to the interaction area according to the first relative position.

In a possible implementing manner, the deformable interaction surfaceimplements interaction with an interaction object by using aninteraction unit array that comprises multiple interaction units, andeach effective interaction area corresponds to multiple interactionunits.

In a possible implementing manner, the splicing may be performingreaddressing on addresses of interaction units in the multiple effectiveinteraction areas, to obtain a new address that matches the interactionarea.

For example, it is assumed that in the implementing manner shown in FIG.2a , before the folding deformation, first addresses (x,y) ofinteraction units comprised in the folding area 221 and the folding area222 (where x is a first row address, y is a first column address, and ina possible implementing manner, the first address may also be used ascoordinates of a position of an interaction unit on the deformableinteraction surface) are shown in Table 1 and Table 2:

TABLE 1 First addresses of 30 interaction units comprised in the foldingarea 221 13, 1 13, 2 13, 3 13, 4 13, 5 13, 6 13, 7 13, 8 13, 9 13, 1014, 1 14, 2 14, 3 14, 4 14, 5 14, 6 14, 7 14, 8 14, 9 14, 10 15, 1 15, 215, 3 15, 4 15, 5 15, 6 15, 7 15, 8 15, 9 15, 10

TABLE 2 First addresses of 30 interaction units comprised in the foldingarea 222 40, 1 40, 2 40, 3 40, 4 40, 5 40, 6 40, 7 40, 8 40, 9 40, 1041, 1 41, 2 41, 3 41, 4 41, 5 41, 6 41, 7 41, 8 41, 9 41, 10 42, 1 42, 242, 3 42, 4 42, 5 42, 6 42, 7 42, 8 42, 9 42, 10

In this implementing manner, if readdressing is performed on addressesof the interaction units in the two folding areas 221, 222 according torelative positions in space of the two folding areas 221, 222 in thefirst shape after the folding deformation shown in FIG. 2c , secondaddresses (x1,y1) of the interaction units as shown in Table 3 and Table4 may be obtained:

TABLE 3 Second addresses of the 30 interaction units comprised in thefolding area 221 1, 1 1, 2 1, 3 1, 4 1, 5 1, 6 1, 7 1, 8 1, 9 1, 10 2, 12, 2 2, 3 2, 4 2, 5 2, 6 2, 7 2, 8 2, 9 2, 10 3, 1 3, 2 3, 3 3, 4 3, 53, 6 3, 7 3, 8 3, 9 3, 10

TABLE 4 Second addresses of the 30 interaction units comprised in thefolding area 222 4, 1 4, 2 4, 3 4, 4 4, 5 4, 6 4, 7 4, 8 4, 9 4, 10 5, 15, 2 5, 3 5, 4 5, 5 5, 6 5, 7 5, 8 5, 9 5, 10 6, 1 6, 2 6, 3 6, 4 6, 56, 6 6, 7 6, 8 6, 9 6, 10

It may be seen that, after readdressing is performed on the addresses ofthe interaction units in the two folding areas 221, 222, secondaddresses of multiple interaction units respectively comprised in thetwo adjacent folding areas 221, 222 after the folding deformation arealso adjacent and consecutive.

In another possible implementing manner, in the splicing, readdressingmay also be not performed on the addresses of the interaction units inthe multiple effective interaction areas, that is, the addresses of theinteraction units are kept unchanged, but correlations between theaddresses are changed.

For example, in a scenario in which the interaction units are scannedduring interaction with an interaction object, the first address (15,10)of the last interaction unit of the folding area 221 and the firstaddress (40,1) of the first interaction unit of the folding area 222 arecorrelated, to cause that during interaction of interaction informationwith an interaction object, after the last interaction unit of thefolding area 221 is scanned, the first interaction unit of the foldingarea 222 is scanned next, and another area between the two folding areas221, 222 is no longer scanned.

In still another possible implementing manner, the splicing may also bevirtual splicing, and the interaction area is a virtual interactionarea, that is, according to the first relative position, the multipleeffective interaction areas are virtually spliced and mapped onto thevirtual interaction area.

In a possible implementing manner, optionally, S130 may furthercomprise:

determining multiple pieces of input interaction sub-informationcorresponding to the multiple effective interaction areas; and

mapping the input interaction sub-information from the multipleeffective interaction areas to the interaction area according to thefirst relative position, to obtain input interaction informationcorresponding to the interaction area.

In a possible implementing manner, the input interaction information,for example, may be input sensing information. For example, in apossible implementing manner, the multiple effective interaction areascomprise multiple input sensing units, and the input sensing informationis sensing information, for example, current information, voltageinformation, and the like, of the multiple input sensing units.

In a possible implementing manner, the interaction apparatus comprisesthe deformable interaction surface, and the determining the inputinteraction information corresponding to the multiple effectiveinteraction areas may comprise:

collecting the input interaction sub-information by using multiple inputsensing units corresponding to the multiple effective interaction areason the deformable interaction surface.

In another possible implementing manner, when the interaction apparatusdoes not comprise the deformable interaction surface, the determiningthe input interaction information may further be acquiring the inputinteraction sub-information from at least one external device by using amanner of communication.

After the input interaction sub-information is acquired, because themultiple effective interaction areas are distributed on the deformableinteraction surface in a scattered manner, the input interactionsub-information needs to be mapped from the multiple effectiveinteraction areas to the interaction area according to the firstrelative position to accurately determine input content corresponding tothe input interaction information.

In a possible implementing manner, optionally, S130 may furthercomprise: determining input content corresponding to the inputinteraction information at least according to the input interactioninformation.

For example, in a possible implementing manner, the input content, forexample, may be input instruction corresponding to the input interactioninformation.

When the deformable interaction surface is a light information inputsurface, the input content, for example, may be image content, or hiddeninformation corresponding to the image content, and the like.

When the deformable interaction surface is a sound information inputsurface, the input content, for example, may be a sound-controlinstruction corresponding to sound information, and the like.

It may be seen that, by using the foregoing implementing manner, aninteraction effect of interaction between an interaction object and theinteraction apparatus by using the multiple effective interaction areasmay be the same as or similar to an interaction effect of interactionwith the interaction apparatus by using the interaction area.

A person skilled in the art may understand that, in the foregoing methodof specific implementing manners of the present application, sequencenumbers of steps do not mean an order of executing the steps, where theorder of executing the steps should be determined by the functions andinternal logic of the steps, and should not constitute any limitation onimplementation processes of the specific implementing manners of thepresent application.

As shown in FIG. 4, an embodiment of the present application furtherprovides an interaction apparatus 400, comprising:

an information determining module 410, configured to determine shaperelated information of a deformable interaction surface, where the shaperelated information corresponds to a first shape of the deformableinteraction surface after a folding deformation;

an area determining module 420, configured to determine multipleeffective interaction areas on the deformable interaction surface atleast according to the shape related information, where the multipleeffective interaction areas meet the following conditions: innonadjacent positions on the deformable interaction surface, andadjacent in a spatial position in the first shape; and

an information input interface providing module 430, configured to usethe multiple effective interaction areas as one interaction area atleast according to a first relative position of the multiple effectiveinteraction areas in the spatial position in the first shape to providean information input interface to at least one interaction object.

In an implementing manner in this embodiment of the present application,after a deformation of a deformable interaction surface occurs, multipleeffective interaction areas adjacent in a spatial position arerecombined to obtain one new interaction area used to provide aninformation input interface to an interaction object, thereby bringingnew experience to a user by using a deformation property of a deformabledevice.

The modules and units in this embodiment of the present application arefurther described by using the following implementing manners.

In a possible implementing manner, optionally, the shape relatedinformation may comprise:

the first shape information of the first shape.

In another possible implementing manner, optionally, the shape relatedinformation may also be not the first shape information, and instead mayindirectly obtain other information of the first shape information. Forexample, the shape related information comprises:

second shape information of a second shape of the deformable interactionsurface before the folding deformation, and deformation informationcorresponding to the folding deformation.

Here, the deformation information may be a shape change parameter, ormay be another parameter related to a deformation. For example, when thedeformable interaction surface is a thermally-induced deformationmaterial, the deformation information may comprise temperature changeinformation and the like of areas. Alternatively, for example, thedeformation information may further be displacement information, ofareas on the deformable interaction surface, acquired by using anacceleration sensing array, a gyroscope array, and the likecorresponding to the deformable interaction surface.

A person skilled in the art may know that the first shape may also bedetermined according to the second shape information and the deformationinformation.

In a possible implementing manner, the deformable interaction surface isan interaction surface whose deformation is controllable, and isconfigured to perform different deformations according to differentdeformation control instructions. The deformation control instructionmay be generated in response to an interaction object interactionoperation. In a possible implementing manner, according to a beforehandsetting, each deformation control instruction may correspond to shapeinformation after a deformation; or may correspond to a piece ofdeformation information. Therefore, in a possible implementing manner,as shown in FIG. 5a , the information determining module 410 comprises:

a first information determining unit 411, configured to determine theshape related information at least according to a deformation controlinstruction,

where the deformation control instruction is used to control the foldingdeformation of the deformable interaction surface.

In a possible implementing manner, the first information determiningunit 411 may, for example, acquire a correspondence between at least onedeformation control instruction and at least one piece of deformationrelated information from a storage module according to the deformationcontrol instruction, where the storage module stores the correspondence,and then obtain deformation related information corresponding to thedeformation control instruction.

In addition to the foregoing the deformation control instruction, adeformation sensor configured to acquire corresponding deformationsensing information according to a deformation of the deformableinteraction surface may be further used to obtain the deformationrelated information. The deformation sensor, for example, may generate acorresponding voltage or current parameter value according to adeformation of the deformable interaction surface, where the deformationsensing information is the voltage or current parameter value.Therefore, in a possible implementing manner, as shown in FIG. 5b , theinformation determining module 410 may comprise:

a second information determining unit 412, configured to determine theshape related information at least according to deformation sensinginformation for the deformable interaction surface.

In a possible implementing manner, that the multiple effectiveinteraction areas are adjacent in the spatial position comprises:

for a first effective interaction area of the multiple effectiveinteraction areas, at least another effective interaction area that isadjacent in the spatial position to the first effective interaction areaexists,

where the first effective interaction area is any effective interactionarea of the multiple effective interaction areas.

In a possible implementing manner, that two effective interaction areasare adjacent in a spatial position may be that a distance between nearbyedges of the two effective interaction areas is approximately 0.

Alternatively, in another possible implementing manner, that twoeffective interaction areas are adjacent in a spatial position may bethat a distance between nearby edges of the two interaction areas isless than a set value.

In some possible implementing manners, the set value may be determinedaccording to influence of the distance on interaction of the interactionobject.

In a possible implementing manner, in addition to the shape relatedinformation, other information may further need to be combined to obtainthe multiple effective interaction areas.

For example, in a possible implementing manner, interaction between thedeformable interaction surface and the interaction object isdirectional. For example, the deformable interaction surface is a soundinput surface and is configured to receive a directional sound beam. Inthis implementing manner, the area determining module 420 is furtherconfigured to:

determine the multiple effective interaction areas on the deformableinteraction surface according to the shape related information and asecond relative position of an interaction object relative to thedeformable interaction surface after the folding deformation.

In some possible implementing manners, the second relative position maybe acquired in real time. For example, the second relative position maybe acquired by using an interaction object position sensor on a side ofthe deformable interaction surface or by means of communication withanother device on a side of the interaction object.

In other possible implementing manners, the second relative position maybe set by default, for example, is a common second relative positionobtained according to use habits of multiple users, or is a secondrelative position obtained according to a setting by a user.

The second relative position is combined to determine the multipleeffective interaction areas, which may make it more convenient for theuser to use the interaction apparatus. For details, reference is made tothe corresponding description in the foregoing method embodiments.

In a possible implementing manner, as shown in FIG. 5a , the areadetermining module 420 comprises:

a folding area determining unit 421, configured to determine, accordingto the shape related information, multiple folding areas where multipleoutwardly-bending end surfaces are located, where the multipleoutwardly-bending end surfaces are adjacent in the spatial position onthe deformable interaction surface in the first shape; and

an area determining unit 422, configured to determine the multipleeffective interaction areas at least according to the multiple foldingareas.

In a possible implementing manner, the multiple effective interactionareas are the multiple folding areas. Therefore, in this implementingmanner, as shown in FIG. 5a , the area determining unit 422 comprises:

a first determining subunit 4221, configured to determine that themultiple folding areas are the multiple effective interaction areas.

In some possible implementing manners, in addition to the foregoing themultiple folding areas, the multiple effective interaction areas mayfurther comprise another area that is adjacent to or is connected to themultiple folding areas in the spatial position after the foldingdeformation occurs. Therefore, in this implementing manner, as shown inFIG. 5c , the area determining unit 422 comprises:

a second determining subunit 4222, configured to determine the multipleeffective interaction areas at least according to the multiple foldingareas and the first shape.

In a possible implementing manner, as shown in FIG. 5d , optionally, theinformation input interface providing module 430 may comprise:

an area splicing unit 431, configured to perform splicing on themultiple effective interaction areas according to the first relativeposition to form the interaction area. For a specific splicing manner,reference is made to the corresponding description in the foregoingmethod embodiments.

In a possible implementing manner, as shown in FIG. 5d , optionally, theinformation input interface providing module 430 may comprise:

an information determining unit 432, configured to determine multiplepieces of input interaction sub-information corresponding to themultiple effective interaction areas; and

an information mapping unit 433, configured to map the multiple piecesof input interaction sub-information from the multiple effectiveinteraction areas to the interaction area according to the firstrelative position, to obtain input interaction information correspondingto the interaction area.

In a possible implementing manner, as shown in FIG. 5d , optionally, theinformation input interface providing module 430 may further comprise:

an input content determining unit 434, configured to determine inputcontent corresponding to the input interaction information at leastaccording to the input interaction information.

For further description of functions of modules and units in thisembodiment of the present application, reference is made to thecorresponding description in the foregoing method embodiments.

Application scenarios in the embodiments of the present application aredescribed below respectively with the deformable interaction surfacebeing a light information input surface, a sound information inputsurface, and a touch sensing surface. When the deformable interactionsurface is any of the foregoing interaction surfaces, a manner ofdetermining shape related information of the deformable interactionsurface, determining multiple effective interaction areas of thedeformable interaction surface, and performing splicing on the multipleeffective interaction areas to obtain the interaction area is similar tothat in the embodiments shown in FIG. 1, FIG. 2a to FIG. 2e , and FIG.3a and FIG. 3b , and is no longer elaborated below.

In a possible implementing manner, optionally, the light informationinput surface is a deformable image sensing surface.

In this implementing manner, as compared with the embodiments shown inFIG. 1, FIG. 2a to FIG. 2e , and FIG. 3a and FIG. 3b , particularly,after the multiple effective interaction areas are determined, themultiple effective interaction areas are used as one new interactionarea to provide an image sensing interface to an interaction object.

In a possible implementing manner, the multiple effective interactionareas are used as one new interaction area to provide an image sensinginterface to an interaction object may comprise:

determining the second image sensing information corresponding to theinteraction area.

In a possible implementing manner, the determining the second imagesensing information corresponding to the interaction area may furthercomprise:

determining multiple pieces of image sensing sub-informationcorresponding to the multiple effective interaction areas, for example,acquiring image sensing data corresponding to the multiple effectiveinteraction areas, to obtain the multiple pieces of image sensingsub-information; and

mapping the multiple pieces of image sensing sub-information from themultiple effective interaction areas to the interaction area accordingto the first relative position, to obtain the second image sensinginformation.

In a possible implementing manner, as shown in FIG. 6a and FIG. 6b ,five pieces of image sensing sub-information obtained by using the fivefolding areas 221 to 224 (where one folding area is not shown) shown inFIG. 2a respectively correspond to five image areas 611 to 615, and thefive pieces of image sensing sub-information are mapped to aninteraction area 610. The obtained second image sensing informationcorresponds to a smiley face image shown in FIG. 6 b.

Here, the mapping the multiple pieces of image sensing sub-informationfrom the multiple effective interaction areas to the interaction areaaccording to the first relative position, to obtain the second imagesensing information may be implemented by using multiple manners, forexample:

a) Implementation on an application layer: The first relative positionis acquired by using a photography application or a video recordingapplication, and mapping processing is performed according to the firstrelative position on the first image sensing information (for example,sensing information corresponding to an image shown in FIG. 6a ) that isacquired from a bottom layer and that corresponds to the deformableimage sensing surface. Image sensing information of an area other thanthe multiple effective interaction areas is deleted, and mapping andsplicing are performed on multiple pieces of image sensingsub-information corresponding to the multiple effective interactionareas to acquire the second image sensing information corresponding tothe interaction area 610.

Implementation on the application layer is more flexible. Eachapplication may have its own implementation method. However, a workingamount is also increased, because each application needs to implementits own processing method.

b) Implementation on an image sensor driver:

b1) An implementation that may be similar to that in an applicationlayer, and a difference only lies in that all applications share a sameprocessing manner. An image sensor driver program maintains asegmentation parameter corresponding to the first relative position,directly performs mapping processing on collected data (that is, thefirst image sensing information), and delivers processed data (that is,the second image sensing information) to an upper-layer application.

b2) For another implementation, an image sensor driver may be used tocontrol hardware of the deformable image sensing surface forimplementation. For example, an image sensor driver is used to set avalue of a control register related to the deformable image sensingsurface for implementation. For example, by means of the foregoingsetting, the control register forbids data reading or collection in anarea other than the multiple effective interaction areas, so that theimage sensing data output from the deformable image sensing surface isthe second image sensing information.

A person skilled in the art may know that in some possible implementingmanners, a device may use any one of the foregoing three manners toimplement the mapping. Here, the device may be selected flexiblyaccording to a requirement. Certainly, for a device that selects one ofmultiple layers in real time to perform mapping, data to be captured ineach frame may be labeled with whether the data has been mapped and onwhich layer the data expects to be mapped.

In another possible implementing manner, when the interaction apparatusdoes not comprise the deformable image sensing surface, the determiningthe second image sensing information may further be acquiring the secondimage sensing information from at least one external device by using amanner of communication.

In a possible implementing manner, optionally, the sound informationinput surface is a deformable sound sensing array surface.

In a possible implementing manner, the deformable sound sensing arraysurface, for example, may comprise: a flexible substrate surface andmultiple sound sensing units distributed in an array on the flexiblesubstrate surface, for example, multiple microphone units. In a possibleimplementing manner, the flexible substrate surface may be a flexibledisplay screen or a flexible display touch screen, and the sound sensingunits are transparent sound sensing units.

In another possible implementing manner, the deformable sound sensingarray surface, for example, may further be a flexible film sound sensingarray surface.

In this implementing manner, as compared with the embodiments shown inFIG. 1, FIG. 2a to FIG. 2e , and FIG. 3a and FIG. 3b , particularly,after the multiple effective interaction areas are determined, themultiple effective interaction areas are used as one new interactionarea to provide a sound sensing interface to an interaction object.

In a possible implementing manner, the using the multiple effectiveinteraction areas as one new interaction area to provide a sound sensinginterface to an interaction object comprises:

determining sound sensing information corresponding to the interactionarea.

In the foregoing scenario in which readdressing is performed andcorrelations between addresses are changed to obtain the interactionarea, if the interaction apparatus comprises the deformable soundsensing array surface, the determining sound sensing informationcorresponding to the interaction area may comprise: obtaining the soundsensing information according to positions, in the interaction area, ofall sound sensing units comprised in the interaction area and soundsensing data obtained all the sound sensing units.

In another possible implementing manner, the determining sound sensinginformation corresponding to the interaction area may further comprise:

determining multiple pieces of sound sensing sub-informationcorresponding to the multiple effective interaction areas, for example,performing sound sensing scanning on the multiple effective interactionareas respectively, to obtain the multiple pieces of sound sensingsub-information; and

mapping the sound sensing sub-information from the multiple effectiveinteraction areas to the interaction area according to the firstrelative position, to obtain the sound sensing information correspondingto the interaction area.

In another possible implementing manner, when the interaction apparatusdoes not comprise the deformable sound sensing array surface, thedetermining the sound sensing information may further be acquiring thesound sensing information from at least one external device by using amanner of communication.

By using the foregoing implementing manner, an interaction effect ofinteraction between an interaction object and the interaction apparatusby using the multiple effective interaction areas may be the same as orsimilar to an interaction effect of interaction with the interactionapparatus by using the interaction area.

A microphone array of a flexible substrate is used as an example belowto further describe this embodiment of the present application.

FIG. 7a shows a distribution of multiple microphone units 710 of amicrophone array 700 on a flexible substrate 720, where the multiplemicrophone units 710 are in a 5*9 array.

After a folding deformation, for example, areas where the first, thethird, the fourth, the sixth, the seventh, and the ninth columns ofmicrophone units are located are covered or face different directions.Therefore, the areas where the six columns of microphone units arelocated are no longer effective interaction areas. In this implementingmanner, when a sound input of an interaction object is detected, the sixcolumns of microphone units may not need to be driven, so as to forbidsound sensing of the six columns of microphone units, so thatself-interference is avoided and power consumption can be lowered. Areaswhere the second, the fifth, and the eighth columns of microphone unitsare located are three folding areas 711 to 713 of a shape after thefolding deformation, so as to form three effective interaction areasafter the folding deformation. Positions and a distribution of themicrophone units 710 on the three effective interaction areas after thefolding deformation are shown in FIG. 7b . It may be seen that,positions of the three effective interaction areas on the microphonearray 700 are not adjacent, and are adjacent in a spatial position aftera current time of folding deformation, so as to form a new interactionarea 730.

As shown in FIG. 7c , after a directional sound beam from an interactionobject is propagated to the interaction area 730, the second, the fifth,and the eighth columns of microphone units may be driven at the sametime (for example, by using multiple weight factors), and directionalsound collection is performed on the sound beam, so that sound sourcepositioning and the like can be implemented. In this implementingmanner, synthesis may be performed according to positions of themicrophone units 710 on the interaction area 730 and the collected soundinformation to obtain sound sensing information corresponding to thesound beam.

In an implementing manner in which the deformable interaction surface isa deformable touch sensing surface, as compared with the embodimentsshown in FIG. 1, FIG. 2a to FIG. 2e , and FIG. 3a and FIG. 3b ,particularly, after the multiple effective interaction areas aredetermined, the multiple effective interaction areas are used as one newinteraction area to provide a touch sensing interface to an interactionobject.

In a possible implementing manner, the using the multiple effectiveinteraction areas as a new interaction area to provide a touch sensinginterface to an interaction object comprises:

determining touch sensing information corresponding to the interactionarea.

In the foregoing scenario in which readdressing is performed andcorrelations between addresses are changed to obtain the interactionarea, if the interaction apparatus comprises the deformable touchsensing surface, the determining touch sensing information correspondingto the interaction area may comprise: performing overall touch sensingscanning on all touch sensing units comprised in the interaction area,to obtain the touch sensing information.

In another possible implementing manner, the determining touch sensinginformation corresponding to the interaction area may further comprise:

determining multiple pieces of touch sensing sub-informationcorresponding to the multiple effective interaction areas, for example,performing touch sensing scanning on the multiple effective interactionareas respectively, to obtain the multiple pieces of touch sensingsub-information; and

mapping the touch sensing sub-information from the multiple effectiveinteraction areas to the interaction area according to the firstrelative position, to obtain the touch sensing information correspondingto the interaction area.

In another possible implementing manner, when the interaction apparatusdoes not comprise the deformable touch sensing surface, the determiningtouch sensing information may further be acquiring the touch sensinginformation from at least one external device by using a manner ofcommunication.

In a possible implementing manner, the using the multiple effectiveinteraction areas as a new interaction area to provide a touch sensinginterface to an interaction object may further comprise: determininginput content corresponding to the touch sensing information at leastaccording to the touch sensing information.

For example, the user makes a slide gesture in the multiple effectiveinteraction areas 221 to 225 shown in FIG. 2c , a slide trajectory 810corresponding to the gesture passes through four effective interactionareas 222 to 225.

For the deformable touch sensing surface 200, as shown in FIG. 8a , fourpieces of touch sensing sub-information corresponding to four slidetrajectories 811 to 813 (a slide trajectory corresponding to theeffective interaction area 225 is not shown in FIG. 8a ) that arediscretely distributed on the deformable touch sensing surface 200 andare continuous in time may be determined by using a touch sensing arraycorresponding to the deformable touch sensing surface 200.

The four pieces of touch sensing sub-information are mapped from themultiple effective interaction areas 221 to 225 to an interaction area820 corresponding to the multiple effective interaction areas 221 to225, so that touch sensing information corresponding to the slidetrajectory 810 may be obtained, as shown in FIG. 8 b.

In a possible implementing manner, the using the multiple effectiveinteraction areas as a new interaction area to provide a touch sensinginterface to an interaction object may further comprise: determininginput content corresponding to the touch sensing information at leastaccording to the touch sensing information.

For example, in the implementing manner shown in FIG. 8a and FIG. 8b ,the input content, for example, may be an input instructioncorresponding to the touch sensing information.

In some possible implementing manners, the touch sensing information maycomprise distance information. For example, in the implementing mannershown in FIG. 8a and FIG. 8b , the touch sensing information comprisesdistance information from a starting point of the slide trajectory 810.Here, because the slide trajectory 810 is a straight line trajectory, adistance corresponding to the distance information is a length of theslide trajectory 810.

In some possible implementing manners, the distance information isrelated to the input content. For example, a gesture corresponding tothe slide trajectory 810 is used to adjust display brightness of adisplay screen. When the length of the slide trajectory is greater thana set value, the display brightness is adjusted by 20%. In some possibleimplementing manners, after a folding deformation of the deformabletouch sensing surface occurs, under the limit that the size of theinteraction area is reduced, a user cannot conveniently implement agesture corresponding to input content in the interaction area.Therefore, in this implementing manner, the determining input content atleast according to the touch sensing information comprises:

determining reference touch sensing information corresponding to thetouch sensing information at least according to a scaling ratio of theinteraction area relative to the deformable touch sensing surface, wherethe reference touch sensing information comprises reference distanceinformation between which and the distance information the scaling ratiois met; and

determining the input content according to the reference touch sensinginformation and a correspondence between at least one piece of referencetouch sensing information and at least one piece of input content.

In this implementing manner, a second correspondence between at leastone piece of reference touch sensing information and at least one pieceof input content may be a correspondence between at least one piece oftouch sensing information and at least one piece of input contentcorresponding to an unfolded state of the deformable touch sensingsurface.

In a possible implementing manner, the scaling ratio may be a ratio ofan area of the interaction area to an area of the deformable touchsensing surface. In another possible implementing manner, if distanceinformation has a directional limit, the scaling ratio is also relatedto a direction. For example, the distance information comprises: adistance in a length direction and/or a distance in a width direction,and the like, the scaling ratio may further be a ratio of a length ofthe interaction area to a length of the deformable touch sensingsurface, and/or a ratio of a width of the interaction area to a width ofthe deformable touch sensing surface, and the like.

For example, in the implementing manner shown in FIG. 8a and FIG. 8b , ascaling ratio of the interaction area 820 to the deformable touchsensing surface 200 is, for example, 1:10 in the length direction, and1:1 in the width direction. From the starting point of the slidetrajectory 810, a distance in a length direction is dy, and a distancein a width direction is dx.

It is determined that for a first reference slide trajectorycorresponding to the slide trajectory 810, a distance in the lengthdirection is 10*dy, and a distance in a width direction is dx.

The following correspondence exists between a reference slide trajectoryand input content:

when a distance in the length direction of the reference slidetrajectory is greater than a set distance threshold Dsy, brightness ofthe display screen is turned up by 20%.10*dy>Dsy>dy.

It may be determined according to the correspondence and the distance inthe length direction of the reference slide trajectory that inputcontent corresponding to the slide trajectory 810 is: the brightness ofthe display screen is turned up by 20%.

by using this implementing manner, a problem that an original gestureinput cannot or can hardly be accomplished because a size of aninteraction area changes can be avoided.

By using the foregoing implementing manner, an interaction effect ofinteraction between an interaction object and the interaction apparatusby using the multiple effective interaction areas may be the same as orsimilar to an interaction effect of interaction with the interactionapparatus by using the interaction area.

A flexible sensing-type capacitive screen is used as an example below tofurther describe this embodiment of the present application.

FIG. 9a shows a distribution of six top-layer Y-axis electrodes Y1 to Y6and nine bottom-layer X-axis electrodes X1 to X9 of the flexiblesensing-type capacitive screen 900.

After a folding deformation, areas corresponding to four X-axiselectrodes X3, X4, X6, and X7 are covered, two X-axis electrodes X1 andX9 are folded onto a lateral surface perpendicular to a paper plane, andit is inconvenient for a user to perform input interaction in adirection towards the paper plane. Therefore, all these six X-axiselectrodes are no longer effective interaction areas. In thisimplementing manner, when a user input is detected, these six X-axiselectrodes may not need to be driven (while the six Y-axis electrodesstill need to be driven), so that self-interference is avoided and powerconsumption can be lowered. In addition, areas where three X-axiselectrodes X2, X5, and X8 are located are three folding areas 911 to 913of the shape after the folding deformation, so as to form threeeffective interaction areas after the folding deformation. Positions anda distribution of electrodes of the three effective interaction areasafter the folding deformation are shown in FIG. 9b . It may be seenthat, positions of the three effective interaction areas on the flexiblesensing-type capacitive screen 900 are not adjacent, and are adjacent ina spatial position after a current time of folding deformation.

The three X-axis electrodes X2, X5, and X8 are correlated as adjacentelectrodes to splice the three effective interaction areas to obtain aninteraction area 920 after the folding deformation, and a user mayperform touch input with the interaction area 920.

As shown in FIG. 9c , on the interaction area 920, an input contact 930of a user is detected as changes in sensing capacitance corresponding tofour electrode nodes: (X2, Y3), (X2, Y4), (X5, Y3), and (X5, Y4), andbecause of an approximation relationship of the four electrode nodes, aninput of the user is determined as a single-point input whose area is A(which comprises the foregoing four electrode nodes). A person skilledin the art may know that if the three X-axis electrodes X8, X5, and X2are not correlated as adjacent electrodes, the system determines theinput as two multi-point inputs each having an area of B (a first pointcomprising two electrode nodes (X2,Y3) and (X2,Y4) and a second pointcomprising two electrode nodes (X5,Y3) and (X5,Y4)), to cause that theuser cannot perform a correct input operation by using the flexiblesensing-type capacitive screen 900 after a folding deformation.

FIG. 10 is a schematic structural diagram of user equipment 1000according to an embodiment of the present application. In a specificembodiment of the present application, a specific implementation of theuser equipment 1000 is not limited. As shown in FIG. 10, the userequipment 1000 may comprise:

a processor 1010, a communication interface 1020, a memory 1030, and acommunication bus 1040.

The processor 1010, the communication interface 1020, and the memory1030 accomplish communication with each other by using the communicationbus 1040.

The communication interface 1020 is configured to communicate with anetwork element such as a client.

The processor 1010 is configured to execute a program 1032, andspecifically may execute related steps in the foregoing methodembodiment.

Specifically, the program 1032 may comprise program code, where theprogram code comprises a computer operation instruction.

The processor 1010 may be a central processing unit (CPU), or anapplication specific integrated circuit (ASIC), or may be configured asone or more integrated circuits that implement this embodiment of thepresent application.

The memory 1030 is configured to store the program 1032. The memory 1030may comprise a high-speed RAM, or may further comprise a non-volatilememory, for example, at least one magnetic disk memory. The program 1032specifically may be configured to cause the user equipment 1000 toexecute the following operations:

determining shape related information of a deformable interactionsurface, where the shape related information corresponds to a firstshape of the deformable interaction surface after a folding deformation;

determining multiple effective interaction areas on the deformableinteraction surface at least according to the shape related information,where the multiple effective interaction areas meet the followingconditions: in nonadjacent positions on the deformable interactionsurface, and adjacent in a spatial position in the first shape; and

using the multiple effective interaction areas as one interaction areaat least according to a first relative position of the multipleeffective interaction areas in the spatial position in the first shapeto provide an information input interface to at least one interactionobject.

Reference may be made to corresponding description of correspondingsteps and units in the foregoing embodiment for specific implementationof the steps in the program 1032, which is no longer elaborated herein.A person skilled in the art may clearly understand that, for convenienceand simplicity of description, reference may be made to correspondingprocess description in the foregoing method embodiment for a specificworking process of devices and modules described above, which are nolonger elaborated herein.

It can be appreciated by those skilled in the art that each exemplaryunits and method steps described with reference to the embodimentsdisclosed in this text can be implemented by electronic hardware or acombination of computer software and electronic hardware. Whether thesefunctions are executed in a hardware mode or a software mode depends onthe specific applications and design constraint conditions of thetechnical solutions. The professional technicians can use differentmethods to implement the functions described with respect to eachspecific application, but this implementation should not be consideredto go beyond the scope of the present invention.

If the functions are implemented in the form of a software functionalunit and is sold or used as an independent product, it can be stored ina computer-readable storage medium. Based on such understanding, thetechnical solution of the present application essentially or the partwhich contributes to the prior art or a part of the technical solutioncan be embodied in the form of a software product, and the computersoftware product is stored in a storage medium, and comprises severalinstructions for enabling a computer device (which can be a personalcomputer, a server, or network equipment, etc.) to execute all or somesteps of the method described in each embodiment of the presentapplication. The foregoing storage medium comprises various media whichcan store a program code, such as a USB disk, a mobile hard disk, aread-only memory (ROM), a random-access memory (RAM), a magnetic disk ora compact disk.

The above implementations are only used to describe the presentapplication, without limiting the present application; variousalterations and variants can be made by those skilled in the art withoutdeparting from the spirit and scope of the present application, so allequivalent technical solutions also belong to the scope of the presentapplication, and the scope of patent protection of the presentapplication should be defined by claims.

What is claimed is:
 1. An interaction method, comprising: determiningshape related information of a deformable interaction surface, where thedeformable interaction surface is at least used to perform informationinput, and the shape related information corresponds to a first shape ofthe deformable interaction surface after a folding deformation;determining multiple effective interaction areas on the deformableinteraction surface at least according to the shape related information,where the multiple effective interaction areas are in nonadjacentpositions on the deformable interaction surface, and are adjacent in aspatial position in the first shape; and using the multiple effectiveinteraction areas as one interaction area at least according to a firstrelative position of the multiple effective interaction areas in thespatial position in the first shape to provide an information inputinterface to at least one interaction object, wherein the using themultiple effective areas as one interaction area comprises: determiningmultiple pieces of input interaction sub-information corresponding tothe multiple effective interaction areas; and mapping the inputinteraction sub-information from the multiple effective interactionareas to the interaction area according to the first relative position,to obtain input interaction information corresponding to the interactionarea.
 2. The method of claim 1, wherein the shape related informationcomprises: the first shape information of the first shape.
 3. The methodof claim 1, wherein the shape related information comprises: secondshape information of a second shape of the deformable interactionsurface before the folding deformation, and deformation informationcorresponding to the folding deformation.
 4. The method of claim 1,wherein the shape related information is determined at least accordingto a deformation control instruction, where the deformation controlinstruction is used to control the folding deformation of the deformableinteraction surface.
 5. The method of claim 1, wherein the shape relatedinformation is determined at least according to deformation sensinginformation for the deformable interaction surface.
 6. The method ofclaim 1, wherein the determining multiple effective interaction areas atleast according to the shape related information comprises: determiningthe multiple effective interaction areas on the deformable interactionsurface according to the shape related information and a second relativeposition of an interaction object relative to the deformable interactionsurface after the folding deformation.
 7. The method of claim 1, whereinthe determining multiple effective interaction areas at least accordingto the shape related information comprises: determining, according tothe shape related information, multiple folding areas where multipleoutwardly-bending end surfaces are located, where the multipleoutwardly-bending end surfaces are adjacent in the spatial position onthe deformable interaction surface in the first shape; and determiningthe multiple effective interaction areas at least according to themultiple folding areas.
 8. The method of claim 7, wherein thedetermining the multiple effective interaction areas at least accordingto the multiple folding areas comprises: the multiple effectiveinteraction areas are the multiple folding areas.
 9. The method of claim7, wherein the determining the multiple effective interaction areas atleast according to the multiple folding areas comprises: determining themultiple effective interaction areas at least according to the multiplefolding areas and the first shape.
 10. The method of claim 1, whereinthat the multiple effective interaction areas are adjacent in thespatial position comprises: for a first effective interaction area ofthe multiple effective interaction areas, at least another effectiveinteraction area that is adjacent in the spatial position to the firsteffective interaction area exists, where the first effective interactionarea is any effective interaction area of the multiple effectiveinteraction areas.
 11. The method of claim 1, wherein the using themultiple effective interaction areas as one interaction area at leastaccording to a first relative position to provide an information inputinterface to at least one interaction object further comprises:performing splicing on the multiple effective interaction areasaccording to the first relative position to form the interaction area.12. The method of claim 1, wherein the using the multiple effectiveinteraction areas as one interaction area at least according to a firstrelative position to provide an information input interface to at leastone interaction object further comprises: determining input contentcorresponding to the input interaction information at least according tothe input interaction information.
 13. A user equipment, wherein theuser equipment comprises: a memory, configured to store a program; and aprocessor, configured to execute the program stored in the memory, theprogram causes the processor to execute the following operations:determining shape related information of a deformable interactionsurface, where the deformable interaction surface is at least used toperform information input, and the shape related information correspondsto a first shape of the deformable interaction surface after a foldingdeformation; determining multiple effective interaction areas on thedeformable interaction surface at least according to the shape relatedinformation, where the multiple effective interaction areas are innonadjacent positions on the deformable interaction surface, and areadjacent in a spatial position in the first shape; and using themultiple effective interaction areas as one interaction area at leastaccording to a first relative position of the multiple effectiveinteraction areas in the spatial position in the first shape to providean information input interface to at least one interaction object,wherein the using the multiple effective interaction areas as oneinteraction area comprises: determining multiple pieces of inputinteraction sub-information corresponding to the multiple effectiveinteraction areas; and mapping the input interaction sub-informationfrom the multiple effective interaction areas to the interaction areaaccording to the first relative position, to obtain input interactioninformation corresponding to the interaction area.
 14. The userequipment of claim 13, wherein the shape related information comprises:the first shape information of the first shape.
 15. The user equipmentof claim 13, wherein the shape related information comprises: secondshape information of a second shape of the deformable interactionsurface before the folding deformation, and deformation informationcorresponding to the folding deformation.
 16. The user equipment ofclaim 13, wherein the shape related information is determined at leastaccording to a deformation control instruction, where the deformationcontrol instruction is used to control the folding deformation of thedeformable interaction surface.
 17. The user equipment of claim 13,wherein the shape related information is determined at least accordingto deformation sensing information for the deformable interactionsurface.
 18. The user equipment of claim 13, wherein the determiningmultiple effective interaction areas at least according to the shaperelated information comprises: determining the multiple effectiveinteraction areas on the deformable interaction surface according to theshape related information and a second relative position of aninteraction object relative to the deformable interaction surface afterthe folding deformation.
 19. The user equipment of claim 13, wherein thedetermining multiple effective interaction areas at least according tothe shape related information comprises: determining, according to theshape related information, multiple folding areas where multipleoutwardly-bending end surfaces are located, where the multipleoutwardly-bending end surfaces are adjacent in the spatial position onthe deformable interaction surface in the first shape; and determiningthe multiple effective interaction areas at least according to themultiple folding areas.
 20. The user equipment of claim 19, wherein thedetermining the multiple effective interaction areas at least accordingto the multiple folding areas comprises: the multiple effectiveinteraction areas are the multiple folding areas.
 21. The user equipmentof claim 19, wherein the determining the multiple effective interactionareas at least according to the multiple folding areas comprises:determining the multiple effective interaction areas at least accordingto the multiple folding areas and the first shape.
 22. The userequipment of claim 13, wherein that the multiple effective interactionareas are adjacent in the spatial position comprises: for a firsteffective interaction area of the multiple effective interaction areas,at least another effective interaction area that is adjacent in thespatial position to the first effective interaction area exists, wherethe first effective interaction area is any effective interaction areaof the multiple effective interaction areas.
 23. The user equipment ofclaim 13, wherein the using the multiple effective interaction areas asone interaction area at least according to a first relative position toprovide an information input interface to at least one interactionobject further comprises: performing splicing on the multiple effectiveinteraction areas according to the first relative position to form theinteraction area.
 24. The user equipment of claim 13, wherein the usingthe multiple effective interaction areas as one interaction area atleast according to a first relative position to provide an informationinput interface to at least one interaction object further comprises:determining input content corresponding to the input interactioninformation at least according to the input interaction information.